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On Monotonicity and Propagation of Order 

Properties 

Aivar Sootla 


Abstract —In this paper, a link between monotonicity of 
deterministic dynamical systems and propagation of order 
by Markov processes is established. The order propagation 
has received considerable attention in the literature, how¬ 
ever, this notion is still not fully understood. The main con¬ 
tribution of this paper is a study of the order propagation 
in the deterministic setting, which potentially can provide 
new techniques for analysis in the stochastic one. We take a 
close look at the propagation of the so-called increasing and 
increasing convex orders. Infinitesimal characterisations 
of these orders are derived, which resemble the well- 
known Kamke conditions for monotonicity. It is shown that 
increasing order is equivalent to the standard monotonicity, 
while the class of systems propagating the increasing convex 
order is equivalent to the class of monotone systems with 
convex vector fields. The paper is concluded by deriving a 
novel result on order propagating diffusion processes and 
an application of this result to biological processes. 

I. Introduction 

Deterministic monotone systems (cf. m) have a con¬ 
siderable number of applications, such as control engi¬ 
neering m and biology a to name a couple. Properties 
of monotone control systems include: easy to compute 
bounds on reachability sets ||4l; computation of robust 
open-loop controls for particular applications 0; easy 
to compute feedback controllers 0, 0; availability of 
structured model reduction methods 0, E). 

Monotonicity in the context of Markov processes has 
been introduced in QO), M- Since then this concept 
has been extensively studied and a number of applica¬ 
tions has been discovered. For example, stochastically 
monotone processes play a central role in the perfect 
simulation algorithms IfT^ . Monotone processes are also 
extensively used in risk theory (cf. ifT^ l. queueing theory 
(cf. ini), and financial mathematics (cf. ifMlH . Following 
the nomenclature in m, the term propagation of order 
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will be preferred to the term stochastic monotonicity in 
order to avoid confusion with deterministic definitions. 

The so-called -Ttcx and J'icv-orders have received 
a considerable attention in the literature. At the same 
time the J^icx and J^icv-orders are not entirely understood 
in the context of stochastic processes. Therefore in 
order to advance the state-of-the-art in the stochastic 
setting, we take a closer look at the Fd, -Flex and Ficv 
orders in the deterministic one. First, we show that 
in the deterministic setting the .Fd-order propagation 
is monotonicity in the sense of 0. Then it is shown 
that the systems propagating the .Fex-order (respectively, 
the Fev-order) are monotone systems with a convex 
(respectively, concave) vector field. Note that, the class 
of systems propagating the Ficx-order has been im¬ 
plicitly studied in in the context of deterministic 
control systems, and M in the context of ordinary 
differential equations. However, the proofs presented in 
this paper are different from the existing ones, since they 
are influenced by the definitions of order propagation. 
Using techniques similar to ours it is possible to obtain 
additional propagation results for different orders as 
discussed in Section HIJ 

While studying processes propagating orders, the main 
application in mind was biological systems. It is well- 
known that cellular dynamics can be described by a 
Markov process with Poisson jumps E). Analysis of 
such processes is complicated due to the dependence 
of jumps on a Poisson distribution. Hence often Gaus¬ 
sian approximations of Poisson distributions are consid¬ 
ered, which can result in Chemical Langevin Equation 
(CLE) mil or Linear Noise Approximation (ENA) ini. 
In this paper it is shown that only a collection of de¬ 
coupled birth-date processes described by an ENA prop¬ 
agate the Fd-order, which limits the scope of possible 
applications. On the other hand, it is also shown that all 
unimolecular reactions propagate the Ficx-order and the 
order is propagated through mean and covariance matrix 
of the process. Hence the Fex-order is arguably better 
suited than the Fd-order for comparison of unimolecular 
reactions processes. This result constitutes a step forward 
towards understanding Markov processes propagating 
orders. 


Notation. Let 11-112 stand for the Euclidean norm in K", 
X* stand for a topological dual to X. Let x y stand 
for a partial order in R” induced by the non-negative 
orthant K>o- That is the relation x ^x y is, true for 
vectors x and y if and only if Xi > yi, for all i (or 
x — y€ K>o)- Let x i^x y be true if and only if Xi > yi, 
for all i {oT x — y € R>o)- For a general definition of the 
partial order we refer the reader to lfT9l . The partial order 
u V on the space of control signals u{t) is defined as 
an element-wise comparison Ui{t) > Vi{t) for all i and t. 
The notation X ^psd ^ means that the matrix Y — X is 
positive semidefinite. 1 stands for the vector of ones. 
The operator V/ stands for the gradient of /, while 
V^/ stands for the Hessian of /. Let —S- A4) 

be space of the smooth functions acting from V to M.. 
The operator E[X] stands for the expectation of X, while 
E[Jf|F] stands for the conditional expectation of X with 
respect to cr-algebra generated by Y. We write X Y 
if X and Y have the same probability distribution P. 

IT Preliminaries 

1) Monotone Control Systems: Consider a system 

x = f{x,u) (1) 

where f :V xU ^ M”, V C M", U C u belongs 
to the space of M^-valued measurable functions Uoo- 
The associated flow map is (pf : M>o x V x Uoo 
R", which is denoted as pypt^x^u) and is a solution 
to the system O with the initial state equal to x, and 
the control input u G Uoo- In order to guarantee the 
existence and uniqueness of solutions to O, throughout 
the paper we will assume that the vector field f{x, u) is 
continuous in {x, u) and locally Lipschitz continuous in 
X uniformly on u. This means that for each compact sets 
Cl (I'D and C 2 C U, let there exist a constant k such 
that ||/(^,u) - /(C,m )||2 < fc||C - CII2 for all C Ci 
and u G C 2 . 

Definition 1: The system is said to be monotone with 
respect to R"q x R^q if one of these equivalent state¬ 
ments hold (the equivalence is shown in 1^): 

1) Monotonicity. For allx Yx y,u Yiu v 
4>f{t-,x,u) :<x 4>f{t]y,v) for all t G R>o- 

2) Kamke Conditions. Let u, v inU such that u Yu 
V. \f X, y in 2? are such that Xi = yi for some i 
and Xj < yj for all j i, then fi{x, u) < ffiy, v), 

3) Quasimonotonicity. Let K = R>o, and let K* 
be the topological dual to K, That is K* = 
{g G (R”)*|p(/C) > 0}. For x, y G D, u, v G U 
such that X Yx y, u Yu V and g G K* such that 
g{x) =g{y), we have g{f{x,u)) < g{fiy,v)). 

A generalisation can be defined with respect to any 
orthant by mapping this orthant onto the positive one 


by a linear transformation T : R" —)■ R", where 
T = diag((—1)®L ..., (—for some Si. 

2) Markov Processes Propagating Orders: Here we 
follow the development of stochastic monotonicity the¬ 
ory in Ha, EO). We consider only uncontrolled pro¬ 
cesses for simplicity. But before we proceed, we require 
a few definitions. 

Definition 2: Let g : R" —>■ R™ be called increasing if 
for two vectors x, y such that x Yx y, we have g{x) Yx 
9{y)- 

Let g : R" —R™ be called convex with respect to the 
order Yx if for two vectors x, y and a scalar A G [0,1], 
we have 

g{\x + (1 - \)y) Yx Xg{x) -f g{{l - X)y). 

Let g : R" —5- R'” be called directionally convex with 
respect to the order Yx if for any xi Yx [x 2 ,a: 3 ] Yx X 4 
and xi + X 4 = X 2 + X 3 , we have; 

9{x2) +9{x3) :<x g{xi) +g{x4)- 

The classes Td, Dicx and J^idcx are classes of in¬ 
creasing, increasing convex and increasing directionally 
convex functions from C°°(R" —>■ R"*), respectively. 

If the partial order is induced by the positive orthant 
R", then the definition of convexity with respect to 
the order is a generalisation of convexity to vector¬ 
valued functions. However, if the orthant is not positive, 
then some individual gi{x,u) can be actually concave 
functions of the arguments, but still convex with respect 
to the order. For example, the function f{x, y) = —x^+y 
is convex with respect to the order Yx, if the relation 
X Yx y is implied by xi < X 2 , yi > 2/2 (this order 
is induced by the orthant diag([— 1,1])R%). However, 
f{x,y) is clearly concave in the classical sense. Note 
finally that a function from J^cx cannot increase and be 
convex with respect to two different partial orders. 

Directionally convexity of a twice differentiable func¬ 
tion g in the standard order can be checked by inspecting 
the sign pattern of the Hessian. That is p G J^dcx if and 
only if > 0 for all k, i, j. 

Definition 3: We say that X ^dY (resp., X ^icx Y) 
[resp. X ^idcx Y], if 

E[5(X)] < E[y(y)] 

holds for all g in Td (resp. Jlcx) [resp. J^dcx] for which 
the integrals exist. 

Besides the classes Xd, Xicx, -Fidcx different classes 
of functions can be used li^ . For example, the order in¬ 
duced by the class J^cv of increasing concave functions. 
We will leave a detailed discussion on J^cv and Jidcx 
orders beyond the scope of this paper. The orders Td, 
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J-icx have the following probabilistic interpretations and 
properties. 

Proposition 1: Let X, Y be two random variables. 

1) X ^dY, if and only if X <Y almost surely. 

2) X ^icx Y if and only if X E[Y\X] 

3) Let X - J\f{mx,Yx), Y - J\f{mY,YY). Then 

X ^d T" if and only if mx fny and 

Yx = Yy- If mx dx mY and Yx ^psd Yy, 
then X dicxY. 

The proofs or references to such can be found in ifT^ . 
II 20 I . Instead, we try to provide some intuition behind 
these results. 

The proof of 1) for the univariate case is perhaps the 
easiest to reproduce. Consider the function P{X > t), 
which is equal to Eft{X), where ft{X) is an indicator 
function of the set X > t and hence an increasing 
function. Therefore if X ^d Y, then X < Y almost 
surely. Note that an indicator function is not smooth, 
but it is also possible to show the same result for 
smooth increasing functions. From X < Y almost 
surely, it follows directly that for all increasing func¬ 
tions f{X) < f{Y) almost surely, and hence clearly 
X ^d Y. Note that in order to prove the necessity, a 
nonlinear increasing function was used, hence the usual 
definition monotonicity cannot be extended directly to 
the stochastic case, if one wants to preserve the order in 
the almost surely sense. 

The sufficiency of 2) follows directly from Jensen’s 
inequality as follows 

E{g{X)] < E[p(E[F|X])] < E[E[p(r)|X]] = E[p(y)] 

The necessity proof is omitted, since it is much more 
complicated than sufficiency. Note, however, that the 
necessity requires that E[p(F)] < E[ 5 (X)] for nonlinear 
convex g. 

The Xd-order is the comparison in the almost surely 
sense, therefore comparing variables with different vari¬ 
ances is problematic, which is confirmed in the point 

3). On the other hand the J^cx-order is a comparison of 
conditional expectations. Hence if X generates a weaker 
(T-algebra then Y, then the variables are comparable. 
This condition for the Gaussians is translated into the 
comparison of the variances. This means that the Jdcx- 
order is weaker than Fd for Gaussian distributions. 

The presented below definition of order propagating 
Markov processes is slightly different than the one 
in m. This, however, does not affect any of the 
derivations for stochastic differential equations and does 
not affect the purpose of this definition. 

Definition 4: Let F be one of {Xd, Ficx, -^idcx}- A 
Markov process X{t,XQ) with X(0) = Xq propagates 


the order induced by the class F , if for any g from F , 
the function E[p(X(f, Xo))|X(0) = xq] also belongs to 
X as a function of xq- 

Propagation of Fd, Ficx and JSdcx orders is usually 
referred to as stochastic monotonicity, icx-monotonicity, 
and idcx-monotonicity, respectively. We prefer using the 
term propagation of order in favour of the term stochastic 
monotonicity in order to avoid the use of the word 
’’stochastic” in the context of deterministic systems. 

III. Monotonicity and Order Propagation in 
THE Deterministic Setting 

Deterministic systems can be seen as Markov pro¬ 
cesses with probability densities concentrated at one 
point. Hence, it is straightforward to formulate the order 
propagation in the deterministic setting. 

Definition 5: Let F be one of {Fd, Ficx, -^idcx}- The 
system o propagates the X-order if for any g from F, 
X € D and u G Uoo, we have that g{(j)f{t; x, u)) belongs 
to F. 

The classes of functions Fd, Ficx, -^idcx are proper, 
convex cones in the space C°°. This indicates a clear 
connection between Xd-order propagation and quasi¬ 
monotonicity. However, in the stochastic case, it is 
necessary to include nonlinear functions in the classes F, 
Ficx and Xidcx- Hence, we proceed without the linearity 
assumption on the functions g. Firstly, we establish the 
equivalence of .Fd-order propagation and monotonicity. 

Theorem 1: Consider the system O, then the follow¬ 
ing statements are equivalent: 

1) For X, y G V, u, V G U such that x dx y, u du 
V and g G Fd such that g{x) = g{y), we have 
{Vg{x))^f{x,u) < {Y/g{y))^f{y,v). 

2) The system ([Til propagates the Jy-order. That is 
for all g G Fd, we have that g{(j)f{t; ■, ■)) G Fd 
for all t. 

3) The system ([T]) is monotone according to Defini¬ 
tion [T] 

Proof: All the implications can be shown in a few 
lines, by applying monotonicity results, however, we 
produce direct proofs without involving monotonicity 
results. This is done to illustrate the tools, which are 
used in the sequel. 

[D Let u du V, X dx y- Consider a system 

fm{x,u) = f{x,u) -I- 1/m, where 1 is a vector of 
ones. Let the initial condition be y"* = y + 1/ml, 
and the flow corresponding to the vector field fm be 
y'^{t) = firnifi y"*, v). Let also x{t) = x, u). First, 
we show by contradiction that g{x{t)) < g{y'^{t)) holds 
for all functions g from Fd- For a small t the condition 
g{x{t)) < g{y"^{t)) obviously holds due to continuity of 
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solutions to O- Assume there exists a time r and a non¬ 
trivial function r] G Td such that r]{x{s)) < ri{y'^{s)) 
for all 0 < s < r and ri{x{T)) = r]{y'^{T)) for some m. 
This implies that 




at 


On the other hand 


(Vp(y'"(r)r(/( 2 /-(r),u) + l/m)- 
{yy[x{T))Yf{x(T),u) 

(Vp( 2 /™(r))^l/m >(**) 0, 


where the inequality (*) is due to ([T]i and the inequality 
(*= 1 =) holds since p is a nontrivial increasing function. 
Hence we have 




> 0 , 

t = T 


and arrive at the contradiction. This implies that 
g{cj}f{t-x,u)) < g{ 4 )m{t]y"",v)) for all g G Fd and all 
finite m. Finally, by continuity of solutions with m —cxd 
we have that g{(j)f{t]x,u)) < g{cj}f{t-y,v)), if u v, 

x<xy, g & 

Ell ^[B. Let 5 G be such that for x, y G V, such 
that X Aj, y, we have g{x) = g{y). Let u, v GU u v. 
Due to El- we have that 


b) Let X, y z G V, g G Jicx be such that g{z) = 
y,g{x) + {l — y,)g{y) for some y G [0, 1], then 
for all u, V G U we have; 

{Vg{z)ff{z, yu+{l- y)v) < 
F(Vp(x))'^/(x, u)+(l-y){Vg{y)Yf{y, v) 

2) The system ([T]i propagates the J^icx-order. That is 
for any g from J^icx- we have that g{(j)f{t;-,-)) 
belongs to J^icx for all t. 

3) The system ([T]i is monotone according to Defini¬ 
tion [T] and fi{x,u) are convex functions in {x,u). 

Proof: Throughout the proof of Theorem El we will 
use the following notations x^ = \x + {1 — \)y, = 

Am -f (1 — A)m and z^{t) = x^, u^). 

[B ^El- Due to TheoremlBthe condition ([Tal l implies 
that the flow g{(j)f{t;x,u)) is an increasing function of 
X and u for all g G J^icx- Now we need to show that 
g{(j)f{t;x,u)) is a convex function of x and u. 

Let X™ = X + 1/m, y™ = y + 1/m. Let also 
(l)m{t,x,u) be the flow generated by the system x = 
f{x,u) + 1/m, x™(f) = y'^{t) = 

4>m{t;y'^,v). First, we show that the condition 

giz\t)) < Xgix^it)) + (1 - X)g{y^m (2) 

is valid for all t, all A G [0, 1] and all functions g G J^icx- 
For small times t, we have 


giffit; X, u)) < g{(j)f{t-y, v)) 'it > 0. 

Consequently 

y, v)) - X, u))) = 

C^9iy)ff{y,v) - (^9{x)ff{x,u) > 0 , 

which is the condition [B- 

[B=® The claim follows by applying the conditionEl 
with gi{x) = Xi- 

[3j=® Monotonicity implies that (j>f{t;x,u) is an 
increasing function in {x,u). Since a composition of 
increasing functions is increasing, g{(f)f{t;x,u)) is in 
J^d- ■ 

The next theorem provides necessary and sufficient 
conditions for the system to propagate the J-icx-order. 

Theorem 2: Consider the system dB- The following 
statements are equivalent; 

1) a) Let X, y G V, u, V G U, g G Jicx be such 
that x^^y,u v. If g{x) = g{y), then 

{Vg[x)f'f{x,u) < {Vg{y)ff{y,v) 


g{z^{t)) = g{(/f{t-,xx,ux)) < 

g{(j)f{t-,x\ -G l/m,ux)) < 
Xg{(j)f{t-,x^,u)) -f (1 - X)g{<j)f{t-,y”^,v)), 

where the last inequality holds for t = 0. Hence due 
to continuity of solutions, the condition (EJ holds for 
t = 0 and its vicinity. Assume there exists a time r and 
a nontrivial function g G Jdcx such that for all A G [0, 1] 
and for all 0 < s < r 

g(z^(s)) < Ap(x-(s)) + (1 - X)g(y^(s)), (3) 

while at the time r for some y G [0, 1] we have; 

g(z'^(t)) = pp(x™(r)) + (1 - y)g(y"‘(T)). 

This implies that 


-(p(z^(f))-pp(x-(r)) 


-(l-y)g(y’-(r))) 


>0. (4) 
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On the other hand we have that 

|(ry(z^(t)) - nrjix^ir)) - (1 - ^)r?(y’-(r))) 
(V77(z'"(t)))^/(z^(t),u^)- 
MVr?(x™(r)))^(/(x’"(r),tt) + l/m)- 
(1 - A^)V77(2/™(r))^(/(2/-(T),^) + 1/m) <(*) 

- {piVri{x^{T)) + (1 - < 0, 

where the inequality (*) is due to the condition flbli. We 
arrive at the contradiction with the condition (IHi. Hence 
the inequality (|2]i holds for all f > 0, all A G [0, 1] and 
all g. By continuity of solutions with m — cxd we have 
that 

g[z^{t)) < Xg[(j)f{t-, X, u)) + (1 - X)g[(j)f{t-, y, v)), 

which completes the proof. 

|2]i => [T]i. By Theorem [T] the condition [Tall is implied 
by the fact that the flow g{(j)f{t;x,u)) is an increasing 
function of x and u for all g G -Ficx- Now we need to 
show that if g{(j)f{t; x, u)) is a convex function of x and 
u thenfTbli is fulfilled. 

Let X, y z € V, u, V G U, g G J-icx be such that z :<x 
Ax + (1 - X)y, u diu V, and g{z) = yg{x) + (1 - y)g{y) 
for some y G [0, 1]. Due to convexity of the flow the 
following holds for all t: 

g{z{t)) < yg{(j)f{t-x,u)) + (1 - y)g{(t)f{t]y,v)), 
Take the derivative at f = 0 and obtain 

iy9{z)ff{z,uf^) < m(V3(x))'^/(x,u)+ 

(l-p)(Vp(t/))'^/(j/,u), (5) 

This implies the condition [Tbli and completes the proof. 

[U ^|3ll The claim follows by testing the conditions [Til 

on gi{x} = Xi. 

13 |2]i By repeating the proof for [T]i |2]i with 

r]i{x) = Xi, we get that the flow (j)f{t;x,u) is an 
increasing convex function in x, u. Since any composi¬ 
tion of two increasing convex functions is known to be 
increasing convex, the function g{(j)f{t; x, u)) belongs to 
J^icx for all t > 0, which completes the proof. ■ 

Dynamical and control systems propagating the JTcx 
order were implicitly studied in lIT^ and lITSl . respec¬ 
tively. The major difference between ESI and ESI 
and the presented proof is that it employs infinitesimal 
characterisations E) and common techniques in the 
monotonicity theory. Furthermore, the presented proof 
can be modified in a straightforward manner in order 
to accommodate propagation of different orders. For in¬ 
stance, it is straightforward to modify our proof in order 
to obtain similar results for the /jcv-orderby flipping the 


inequalities and changing 1 /m to — 1 /m. Moreover, it is 
possible to enforce different inequalities on the flow, for 
example it is possible to enforce directional convexity. 

Theorem 3 : Consider the system E}- The following 
statements are equivalent: 

1 ) a) Let X, y GV, u, V GU, g G J^idcx be such 

that X <x y, u :<u v. If g{x) = g{y), then 

(Vg{x)ff{x,u) < C^g{y)ff{y,v) 

b) Let xi, X2 X3, X4 G V, be such that xi :<x 
X2,X3 :<x X4 and g{xi) + gix4) = g{x2) + 
gixs), g G Tidcx- Then for all m, U2, U3, 
U4 G hi such that ui :<u U2,U3 U4 and 
ui + U4 = U2 + U3 we have: 

'^^gix2)fix2,U2)+X/'^gix3)f{x3, U3) < 

V^5(xi)/(xi, iti) -f V'^p(x4)/(X4, U4) 

2 ) The system EJ propagates the J^dcx-order. That is 
for any g from JTdcx, we have that g{(j)f{t;-,-)) 
belongs to J^dcx for all t. 

3 ) The system E) is monotone according to Def¬ 
inition (Tj and fi{x,u) are directionally convex 
functions in (x, u) for all i. 

Proof: (D ^ Ell- Due to Theorem [T] the condi¬ 
tion Eal i implies that the flow g{<j)f{t]X,u)) is an 
increasing function of x and u for all g G J/dcx- Now 
we need to show that g{(j>f{t;x,u)) is a directionally 
convex function of x and u. 

Consider initial conditions Xi, X2, X3, X4, such that 
xi dix X2, X3 fix X4 and xi -f X4 = X2 + X3, as well as 
control signals ui, U2, U3, U4, such that ui fu U2, U3 fx 
U4 and such that m + U4 = U2 + U3. Let x™ = X4 -f 
1/ml, x™(f) = (/m(f,x™,U4) be the flow generated 
by the system x = f{x,u) + 1 /ml. Let also Xi{t) = 
(j)f{t]Xi,Ui). First, we show that the condition 

g{x2{t)) + g{x3{t)) < g{xi{t)) + g{x'f{f)) (6) 

is valid for all t and all functions g G J/dcx- For f = 0 , 
we have 

g{x2{t)) + g{x3{t)) < g{xi{t)) + g{x4{t)) ( 7 ) 

and g{x4{t)) < p(x™(f)). Hence, the inequality (|6]l is 
satisfied for small t = 0 . Assume there exists a time 
T and a nontrivial function p G TTdcx such that for all 
0 < s < T 

v{x2it)) + vix3{t)) < p(xi(f)) -f vix’fit)) (8) 
while at some time r we have: 

g{x2{T)) + p(x3(t)) = p(xi(r)) -f p(x^(r)) 
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This implies that 

^iv{x2{'r))+v{x3ir))-r]{xi{T))-'n{xTiT)))\ > 0 . 

at \t=T 

On the other hand we have that 

^(??(a; 2 (T))+p(a; 3 (T))-? 7 (xi(T))-p(x^(T))) 
at t^r 

V^P(x2(t))/(x2(t),U2(t)) + 
V'^77(a;3(r))/(a;3(r),M3(r))- 
V'^ 77 (a;i(r))/(a;i(r),Mi(T))- 
V^p(a; 4 (T))(/(a; 4 (T),U 4 (r)) + 1 /m) 

— V^77{a:4(T))l/m < 0 

where the inequality ( 1 ) is due to the condition [Tb]|. We 
arrive at the contradiction. Hence the inequality (| 6 ]l holds 
for all t > 0 and all g. By continuity of solutions with 
m ^ cx) we have that 

g{x 2 {t)) + g{x 3 {t)) < g{xi{t)) + g{x4{t)) 

which completes the proof. 

| 2 ]i => [U. By Theorem [T] the condition [Tall is implied 
by the fact that the flow g{(j}f{t;x,u)) is an increasing 
function of x and u for all g G J^dcx- Now we need 
to show that if g{(j}f{t;x,u)) is a directionally convex 
function of x and u then [Tbl i is fulfilled. 

Let xi, X 2 X 3 , X 4 G V, be such that xi :<x X 2 ,X 3 :<x 
X 4 and x\ + X 4 = X 2 + X 3 , g G J-idcx, let also ui, 
U 2 , U 3 , U 4 G U he such that ui :<u U 2 ,U 3 :<x U 4 and 
Ml + M 4 = U 2 + U 3 . Due to directional convexity of the 
flow the following holds for all f > 0 : 

g{x 2 {t)) + g{x 3 {t)) < g{xi{t)) + gix 4 {t)), 

Take the derivative at f = 0 and obtain 

'^g{X2)'^f{x2,U2) + Vgixs)'^ f{x3, U3) < 

'^g{xi)'^f{xi,ui) + Vp(a;4)^/(a;4, M 4 ) (9) 

This implies the condition [Tbli and completes the proof. 
[U The claim follows by testing the conditions [TJ 

on gi{x) = Xi. 

0 | 2 ]i By repeating the proof for [T]i | 2 ]i with 

gi{x) = Xi, we get that the flow (l)f(t;x,u) is an 
increasing directionally convex function in x, u. Since 
any composition of two increasing directionally convex 
functions is known to be increasing directionally convex 
(cf. 1201 ), the function g{cj)f{t-,x,u)) belongs to Jidcx 
for all t > 0, which completes the proof. ■ 

Example 1: Consider a model of a toggle switch, 
which was a pioneering circuit in synthetic biology ll 2 Tll . 
The genetic toggle switch is composed of two mutually 


repressive genes Lad and TetR. We consider a control- 
affine model, which is consistent with a toggle switch 
actuated by light induction 1221 . The dynamical equa¬ 
tions can be written as follows. 

Pi 


xi = 


X2 = 


1 -f {X 2 IP 2 ) 
Pi 

1 -f (Xi/ps) 


■PnXi 


-P6X2, 


( 10 ) 


It is easy to verify that for nonnegative pi the model is 
monotone with respect to orthant diag([l, — 1 ])]R>q and 
the nonlinearties are convex. However, this model is not 
propagating the J^cx-order, since the vector is not convex 
with respect to the orthant diag([l, — 1 ])R>q! Indeed, 
using the change of variables yi = xi, y 2 = —X 2 , it 
is straightforward to obtain the following cooperative 
model in the standard order: 

yi = /i(2/1,2/2) = -P3yi + u, 

l-te/K) „„ 

2)2 = f2{yi,y2) = ^ , -P62/2, 


(2/1/P5) 


where yi{t) > 0, 1 / 2 (i) < 0 for all t < 0. It is easy to 
see that the function fi is convex, while the function /2 
is concave in the orthant diag([l, — 1 ])]R>q. Therefore 
Theorem 12 cannot be applied to the system (fTTT i. 

Consider another change of variables zi = a;i, Z 2 = 
l/a; 2 , and obtain the following dynamical system: 


-Zl = gi{zi,Z 2 ) 


Z 2 = g 2 {zi,Z 2 ) 


P1Z2 

1/P2 + 22 
-zip 4 
1 + Zi/p3 


-P 3 Z 1 + M, 


+ P&Z 2 , 


( 12 ) 


where 


^gi(2l,22) _ PiIP 2 
dz2 (1/P2 + 22)^ 

dg2{zi,Z2) _ zIp4/p5 
dzi {l + zi/p^Y 


V^gi(2l,22) = 


0 

-2pi/p2 
(1/P2 +22) 


V^g2(2l,22) = 


( -‘^zIp4IpI 2z2P4lPb 

(1 -b 2 i/p5)3 

222 P 4 /P 5 


(1 -b Zi/p^Y 
-2p4 


V(l-b2i/p5)2 l-bZi/p5 


\ 


It is straightforward to verify that the vector held satisfies 
the monotonicity condition, while the Hessians have one 
zero eigenvalue and one nonpositive eigenvalue. This 
means that the vector field is concave in the standard 
order. This implies that the original system cni has 
a very specific property: every component of the flow 
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mapping is convex in xi and concave in X 2 in the order 
induced by the orthant diag([l, — 1 ])R”q. 


IV. Remarks on Diffusion Processes 
Propagating the and J^cx orders 


where Wi ^ A/’(0, A/). Let 


Gif (i, x) = E 


h{XK,t)\XK,to = X 


G{t,x) =¥.[h{Xt)\Xt, = x] 


Consider the diffusion process in the form of the 
stochastic differential equation 

Xit,Xo)=Xo+ [ fiX{T,Xo))dT+ 

Jo 

[ a{X{T,Xo))dW, (13) 
Jo 

where W is Brownian motion and the integrals are of 
the Ito type. Let also c(x) be equal to a(x)^f7(x). 
Throughout the section, it is assumed that solutions 
to (foi l exist, which is usually implied by some additional 
assumptions on / and c (see ll2^ ). 

Proposition 2 (Theorem 5.3. in l{24\l ): Let the solu¬ 
tions to (HI exist. The process X{t,Xo) is propagating 
the J^d-order if and only if the functions fi{x) are 
increasing in Xk for all k ^ i, the function Cij{x) 
depends only on Xi and Xj. 

Regarding the propagation of the J^cx-order the liter¬ 
ature is not as rich as in the J^-order case. In fact, only 
sufficient conditions on propagation of the J^cx-order by 
a stochastic diffusion are known M- The next result is 
a generalisation of Lemma 2.5 and Theorem 2.6 in m, 
where the authors required fi to be increasing functions 
in all arguments. 

Proposition 3: Let the strong solutions to (fljl l exist. 
Suppose the functions fi{x) are convex and such that 
the functions fi{x) are increasing in Xk for all k ^ i, 
the functions a{x) are increasing convex functions in 
the space of semidefinite matrices. Then the process 
X{t,Xo) propagates the J^cx-order. 

Proof: The authors of lEl proved their result by 
first discretising the process with time steps A. Then 
they showed that this discrete time process propagates 
the Jdcx order for all A > 0. They have finalised the 
proof by showing that the discrete process propagates the 
Jdcx order, and with A —0 converges to X(t, Aq). Here 
we modify the proof of Lemma 2.5 in Cl by showing 
that the conditions in Proposition |3] are sufficient for 
the discretised process to propagate the Aicx-order for 
a sufficiently small A. 

Let f be in [tQ,T]. Discretise [to,T] into K equidistant 
points for a sufficiently small distance A between the 
points. Consider the following discretised process 

Xk,u+^ = Xkm + /feu) A + a{XK,u)W, 


Due to the existence of strong solutions to (fTSI l we have 
that Gxii, ■) G{t, ■) with fc —>■ cxd . 

We first show the propagation of the Aicx-order by a 
one-step transition of the discrete process, which is an 
operator in the following form 

rX = X + Af{X) + a{X)W, (14) 

where W ^ ffiO, A/). Hence, we need to show that for 
any two random variables Xi and X 2 such that Xi Ajcx 
X 2 we have 

rxi TX 2 (15) 

Unlike d, where this property is shown for any posi¬ 
tive A, we will show it only for small increments A. Due 
to Proposition [T] we can pick the variables Xi and X 2 
such that Xi A(j E(A 2 |Ai), without loss of generality. 
Before showing monotonicity of T, we need to show 
some small auxiliary results. 

Let us show that the following relation holds for any 
realisation Xi of the random variable Xi 

E [A 2 + A/(A2) + <j{X2)W\Xi] ^icx 

xi + Af{xi) + <t{xi)W (16) 

Since the function / is convex so is the function 
X + Af{x) for any fixed A. Hence, by Jensen’s in¬ 
equality we have E(A 2 + A/(A 2 )|xi) E(A 2 |a;i) + 

A/(E(A 2 )|a;i). Due to Lipschitz continuity of f{x), we 
can find a small enough A such that A(/(x) — f{y)) < 

x — y for X y- Hence the function x -f Af{x) is also 
increasing in x for a sufficiently small A. Finally, we 
have that for a small A 

XI + A/(xi) E(A2 |xi) + A/(E(A2)|xi) 
E(A2+A/(A2)|xi) 

since xi f^x E(A 2 |xi) for every realisation 

xi of the random vector Xi. By Jensen’s 
inequality and monotonicity of cr we have 
E(a{X2)\xi) A 

ps(d a(E(A2|xi)) A 

ps(d cr(xi). 

Moreover, E(cr(A 2 )|xi)E(cr(A 2 )|xi)'^ Ap^d 

(T(xi)cr(xi)^. Therefore, by Proposition [T] we have 
a{xi)W Aicx E{(j{X 2 )\xi)W and consequently the 
comparison (fTbl l holds. 
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Now consider the following chain of inequalities, 
where Jensen’s inequality is used again 

E/r(rX2) = EE[h{rX2)\Xi] > E [h{E [rX2\Xi])] = 
Eh (E [X2 + Af{X2) + aiX2)W\Xi]) = 

Ejh{E [X2 +AfiX2)+aiX2)W\xi])P{dxi)> 

E J h{xi+Af{xi)+cr{xi)W)P{dxi)=Eh{rXi). 

where the last inequality holds due to (fT6l l by definition 
of the J'icx-order propagation. Hence we have shown 
that TX2 ^icx TXi, if X2 ^icx Xi. Now it is left to 
show that Gxito, x) belongs to J^icx for sufficiently small 
increments A. By the Markovian property of GK{tQ, •) 
we have 

Gxit, y) = E{h{XK,t)\^K,ta = y) = 

Eh{Tt-A ■■■TtoV) 

Let y be a Bernoulli distribution for yi, 2/2 with a 
distribution Py{Y = yi) = a, PyiX = 2/2) = (1 ~ ct), 
and the mean EF = ayi + {l—a)y2- Clearly EF Ajcx F. 
Using the propagation of the J^icx-order by the operator 
T for all t G [to,T] and a small A we get: 

GK{t,ayi + (1 - a)y2) = fe(f,EF) = 

Eh{rt-A ■.. 7 ^„EF) < Eh{rt-A ■.. Tt^Y) = 
Efe(f, F) = aGxit, 2/1) + (1 - a)GK{t, 2/2) 

Now for every x < y hy the propagation of the J^cx- 
order by T we get: 

x) = Eh{Tt-A ■ ■ ■ TtaX) < 

Eh{Tt-A ■ ■ ■ TtoV) = Gxit, y) 

Hence, GK{t, •) belongs to the class J^icx, which implies 
that G{t, •) belongs to as well and completes the 
proof. ■ 

A. Remarks on Biochemical Processes Propagating Or¬ 
ders 

Biochemical networks are typically modelled by a 
continuous time infinite Markov chain, probability dis¬ 
tribution function of which is computed by a Chemical 
Master Equation (CME): 

^ ^ Ui(n - S'i)P(n - S^, t) - Vi{n)f‘{n, <), 

where R is the number of reactions; column vectors Si 
form a stoichiometry matrix S\ Vi are the reaction rates; 
n is a vector containing the number of molecules rij 
of species j; finally, P(n,f) is the probability of the 


vector of the number of molecules equal to n at time 
t. This equation cannot be solved analytically except 
for a handful of cases and numerical simulations are 
extremely expensive. In order to lower the complexity of 
simulations, different approximations of a CME are often 
employed. One of such approximations is a Chemical 
Langevin Equation (CEE) US): 

dX = Sv{X)dt + SV{X)dW, (17) 

where dW is a vector of Brownian motions, and 
V{X) = diag(-\/r;(A))). In this case, one approximates 
a Poisson distribution with a Gaussian, which is valid 
when the average number of firing reactions per unit time 
is large. One of the technical problems with the CEE is 
that v{X) can take negative values with a small, but 
non-zero probability. In order to avoid these technical 
problems, we illustrate the propagation of order on a 
Linear Noise Approximation, which is valid for reactions 
in a large volume El. 

dx = Sv{x)dt,x{0) = Xo (18) 

drj = J{x)rjdt-\-SV{x)dW, (19) 

where IF is a Brownian motion, x{t) is a deterministic 
variable, Vii{x) = y^Vi{x), Vij{x) = 0 for all i ^ j, 
and J{x) is a Jacobian of Sv{x). 

Consider a set of unimolecular reactions, that is 

Xi -^ki 0, i = 1,... n 
Xi ^ki + nj ; E J 1, . . . , TT 

with the vector of reaction rates in the following form 

Vi{x) = kiXi, i = 1,. ..,n 

Xi-\-nj — ki-\-njXii i^j — 1, . . . , 72, i ^ j 

It is straightforward to verify that we will have Sv{x) = 
Ax, where 

ki+nji i ^ j, 

~ki — 'Ylij=l,j^i f^j+ni i = 3- 

and SV{x)V{x)S'^ is linear in x. consider the elements 
of the diagonal of SV{x)'^ , which are equal to cu = 
iSfjVj{x). Note that by Proposition |2] the function ca 

j 

can depend only on Xi, which implies that if there exists 
Vj which depends on Xm for m ^ i, then Sij = 0. Hence 
the vector Sv{x) can be rewritten as w{x), where Wi{x) 
depends only on Xi, which is a birth-death process. It is 
straightforward to verify that in general only birth-death 
processes propagate the Jvi-order, which limits the scope 
of potential applications. At the same time, we have the 
following result for the propagation of the J'icx-order. 





Proposition 4: A linear noise approximation of any 
network of unimolecular reactions is propagating the 

Jicx-order. 

Proof: This is an adaptation of the proof of 
Lemma 2.5 and Theorem 2.6 in d, hence we will 
only provide a sketch of the proof. Discretise 
into K equidistant points with a distance A between the 
points. Consider the following discretised process with 
L S [fo) T] 

iti+1 = iti + AAit, (20) 

fjti+i = fjti + AAfjt, + SV{xti)W (21) 

where W ~ A/"(0, A/). Let 

- (I;) ") 


First we show the propagation of the Jicx-order by 
a one-step transition operator T of the discrete process, 
which is as follows 


TZ = Z + AAZ + B{Z, IL), 

Let Zi = , Z 2 = we need to 

show that TZ\ Aicx TZ 2 follows from Z\ Aicx ^ 2 - 
Without loss of generality, by Proposition [T] we can pick 
the variables Z\ and Z 2 such that Z\ ]E(2'2|2'i). Now 
for a small enough A the matrix I -f AA is nonnegative, 
hence 


E 


Z 2 “f AAZ2lzi zi AA^^i. 


( 22 ) 


for any realisation zi of the random variable Zi. Con¬ 
sider now the terms B{Z 2 ,W) and B{zi,W). Note 
that v{x) v{y) for all x Ax y, since is a 
linear function of x, which takes only positive values for 
positive X. This implies that for 

any vector ^ and therefore SV'^{x)S'^ Apsd SV‘^{y)S'^ 
for all X Ax V- Hence by Proposition [T] we have 


that E 


with { 2 ^ results in 


B{Z 2 ,W)\zi Aicx B{zi,W), which together 


where zi is a realisation of the random variable Zi. It 
remains to show that E[h{Zt-)\Ztg = zq] belongs to the 
Ticx class for any ti. This part of the proof is equivalent 
to the proof of Proposition |3] and the proofs in na and 
is therefore omitted. ■ 

This proposition indicates that the Ticx order is prop¬ 
agated by the mean and the covariance matrix of the 
process. Hence, by comparing initial distributions, we 
can compare distributions of the process at any point of 
time. This result is naturally related to Proposition [T] 
where it is shown that the J^d-order is equivalent to 
the almost surely comparison, while the J^cx-order is 
equivalent to the comparison of conditional expectations. 
At the same the T^cx-order is still quite restrictive and the 
class of networks propagating the J^cx-order can still be 
too small. However, Proposition |4] shows that imposing 
additional constraints on the propagation class T in 
comparison with J^d entails a larger class of biochemical 
network with a certain monotonicity property. It remains 
to establish, what kind of a class of functions to consider, 
in order to induce a valuable order. 

V. Conclusion and Discussion 

In this paper a step is taken towards a better un¬ 
derstanding of monotonicity (propagation of order) of 
Markov processes. Some novel results for the determin¬ 
istic processes are derived, however, the main application 
in mind is stochastic biological processes. In this paper, 
we make a step forward towards understanding the 
biological processes propagating the order. We do so by 
considering Linear Noise Approximation (of a Master 
Equation), which is a Gaussian process. In this paper, 
it is shown that any LNA propagating the J'd-order is 
a collection of decoupled birth-death processes. At the 
same time any LNA process describing unimolecular 
reactions is propagating the J^cx-order, which entails that 
the order is propagated by the mean and the covariance 
matrix of the process. 


E 


Z 2 + AAZ 2 + B{Z 2 ,W)\zi 


= icx 


zi -f AAzi -f 5(^1, W) 

for any realisation zi of the random variable Zi. Now 
by Jensen’s inequality and the inequality above, we have 


Eh{TZ2) =EK[h{TZ2)\Zi] >E[h{E[TZ2\Zi]] = 
Eh (^E [Z2 -f AAZ2 + B{Z2, lL)|Zi]) = 

eJ h(E\^Z2 + AAZ2 + B{Z2,W)\ziYj P{dzi) > 

E f h(^zi+ AAzi + B{zi,W)^ Pidzi) = Eh{TZi), 
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